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SUMHARY 

A revision of the slaplex method It presented which mekee 
explicit use of columns of the restraint coefficients associated 
with a basic set of variables. The developnent is based on the 
single assumption of linearly independent restraint equations. 

An algebraic method of resolving degeneracy is given in con¬ 



clusion. 
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THE REVISED SIMPLEX METHOD 


Wd. Orchard-Hayt 


INTRODUCTION 

Although thli oourso was deelgnad for thoie Inttrtstad in 
LP computations, it wss felt that a eonoldtrabla amount of thao- 
ratleal background should ba included. While this might be in 
‘the nature of a review for some people, I believe you will all 
agree that the material presented thus far has been very instme— 
tlve and has provided us with a necessary solid and eoanon 
foundation upon which to continue. In fact, a natural questioa 
now night be, that except for computational tricks, what is there 
to say further? Indeed we have enough mathematical theory at 
this point to carry out the computations required by a given LP 
model, at least with a little luck and provided it Is not too 
large. There is, of course, a great deal that has not and can 
not be said in our limited time about model formulation. For 
example, linear approximations to convex functionals are inter¬ 
esting mathematically. The transportation problem, which will 
be discussed in the next two lectures, has at least one result 
of primary importance. But insofar as a genex*al method of 
solution is concerned, the preceding theory is more or lees 
complete except for the matter of degeneraoy. Nevertheleas, we 
have not yet begun, in reality, to speak about the practical 
computational difficulties that confront us nor how we propose 
to resolve them. 



Thttt matters will bt takan up In sort dttail during tht 
aaeond thrat days of tha oouraa. In praparation for thla, tha 
praaant lactura takaa up a ravlaion of tha aimplaz nathod whloh 
la computationally daalrabla. 

In latar laoturaa, wa will find It oonvanlant to uaa a 
■lightly dlffarant notation than was usad in the last one. Also, 
in tha transportation problaa, yau will find an array of quant1- 
tlas with doubla subscripts usad in a dlffarant sense than In 
tha ganaral slmplax nathod. Hanoa this saams lika a good placa 
to introduoa tha notation to ba usad latar on. To thosa of you 
fanillar with laatriz theory, tha vlawpolnt taken In soma of what 
follows nay saam narrow but tha presentation is not Intended to 
ba ganaral fron a matrix theoretical standpoint but only to suit 
our purposes assuming as little background as possible. Altkan, 
in his excellent little book "Determinants and Matrices," says: 
"it would ba intolerably tedious if, whenever we had occasion to 
manipulate sets of aquations or to refer to properties of tha 
ooafflolants, we had to write either the equations or tha sohena 
of coefficients in full. Tha need for an abbreviated notation 
was early fait..." He also refers to matrix notation as the 
shorthand of algebra "expressed at still shorter hand" and as a 
code. This is the viewpoint which will ba useful hare, rather 
than that of abstract algebra. 

LINEAR EQUATIONS; MOTATION 

A linear aquation in n unknowns is one of tha form 
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( 1 ) 






♦ - b 

n n 


whtr« th* a'B and b ara glvan numbara. Tha aubaoripta ara eallad 
indioaa and art uaad to dlatlnguiah dlffarant nxmbara uaad in tha 
aana or alrollar waya. 

For raasona that will appaar praaantly, let ua put tha Indl— 
caa for tha unicnowna aa aupatacrlpta ^inoa thaaa ara linaar 
aquatlona, there la no oonfualon with axponenta) 

(!') .jxl 4 ^ + *„x" - b. 


Suppoae we have several auoh aquationa» aay ■ of thaa, which ara 
to ba aatiafied siaultaneoualy, that la for tha aaaa aat of x*a. 
We can diatlnguiah thaaa by another index on tha a'a and b'a 
which we can also write aa a auperacript: 


(2) 



At thia point It becomaa clear that soiia aort of oondanaad but 
syatamatic notation ia highly daeirabla if not actually naaaa- 
aary. Several schaoMa have bean uaad but they are by no iiaana 
atandardixad. Out of aix standard texts on «y shelf, there ara 
six different notations for thia purpose. However, wa sight, 
for example, write tha a^ aleiaanta of (2) in detached fors, i.a. 
without tha x's and plus signs, but in an array which saintaina 




their rtlativ# positions, and deslgnits this array by the single 
capital latter A. Siailarly write the b's from the right side 
of (2) in a oolumn and call this column B. 


1 
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The array A is called an mxn matrix. B is an mXl matrix. A 
and B are now considered as abstract quantities, i.e. a new kind 
of numerioal animal. There is a whole algebra based on these, 
in which multiplication is defined in a cne-eided way. The 
left factor is always read row-wise and the right factor column¬ 
wise. That is, one multiplies a row on the left by a oolumn on 
the right by summing the products of elements with the sar** 
numerical index, one from each array. The resulting single 
number is the element of the right-hand side with the same index, 
here a superscript, as the row. So if we write the matrix 
equation 

(5) AX - B 

X must be a oolumn and hence has its elements distinguished by 
superscripts in the present system: 




Notf that X It an ml satrlz. Tht alngla aquation (3) now 
■tana axaetly tha aaaa at tha oyataw (2). Wa hava eartalnly 
aehlavad a eondanaatlon In notation. It tenda, howaaar, to go 
a llttla too far and obaeura the Baaa of nuabara with which wa 
ara raally daallng. It alao wakaa it hard to rafar to a pdr~ 
tloular alawant, a particular ooluam or a particular row without 
having four klnda of ayaibola. 

Tha dataehad coluona B and X ara oallad vaotora. Datachad 
rowa ara alao oallad vaotora and thay do not oparata In tha aaaa 
way aa ooluana. If tha dlatlnotlon batwaan rowa and ooluama la 
not aalntalnad, ehaoa raaulta. 

Tha othar ooaaon ahorthand for ayataaa of llnaar aquatlona 
uaaa tha auaaMitlon algn, 1, aa followa. 

(4) 2 •••» ■) 

J-1 J 

whloh raada: Tha aum of tha producta a^ takan for flzad 1 
and j > 1, ...» n glvaa b^ and thla la trua for 1 ■ 1« ...»■• 
Equation (4) haa tha advantagaa of ratalnlng Individual ayabola 
for aaoh alamant and of dlatlngulahlng olaarly rowa and eoluauia. 
Wa will tharafora dlapanaa with tha capital lattara of tha a^ 
atraet notation (3) and alnply wrlta a^* , b^ to aaan tha 

arraya oallad abova k, X, D raapaotlvaly. Slallarly, a alngla 
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row of olcBCntt c^, ...» will bo dtslgntttd liwply e^. 

Noto that tho Itttora used for indleea are unlnportant. 

Va oould juat at well write a|^ or even a^ In place of a^. But 
we aoBetlaea want to refer to a particular row» column or element 
in a matrix. We will reserve the two letters r and s for this 
purpose. Thus Sj means the r^^ row of Sj, a^ means the s^^ 
column of Sj and a* means the element of a^ In row r and column 
a. In other words* when r and s are used* we will understand 
that they are limited to one value and not the whole range 1* ... 
or 1* ...f n. In this lecture we will occasionally use q and t 
In this way also. 

CIMTHAL MATHEMATICAL PROBLEM OF LP 

An LP problem now takes the form 

Given! a^ * a^ * b (i ** 1* ...* mi J ** 1* ...* n} 

Find: x^ > 0 such that 

n . 

£ a^ x** is minimum and 
J-1 J 

£ a^ x^ - b^ (i - 1, ..., m; a < n). 

J-1 ^ 

It seems worthwhile to point out here what the nature of 
the problem really is. We are seeking a non-negative solution 
to a system of linear equations which minimises a linear form. 

The Important fact is that there exists a finite number of fea¬ 
sible solutions in terms of which all others can be expressed. 
These are precisely the basic feasible solutions. The number 



of thtto, howovor, aay bo oory largo, not oxeooding tho auBbor; 

I 

of ooablnatlono of n thlngo takon ■ at a tlao. 



Iron if only a oaall frootion of thooo it foaolblo, thoro may 

1 

bo an awful lot of thoa. For oxaaplo, if n ■ 100, ■ ■ 50 and 

only about 1 In a billion oombinationo it foatiblo, thlo it 

20 * 

atill about 10 batie tolutiona. Tho fact that tho tiaploz . 

BOthod hat novor boon known to itorato through a tignifieant 
fraction of thia numbor of tolutiona to roaoh ono that it 
optimal it ono of tho moro ploaaant phonoaona of lifo. 


LINEAR INDEPENDENCl 


Suppoto it it pottiblo to find olomonta of a row voetor 
^4 (i - 1 , not all core, tuoh that £ X 4 a^ * 0 for 

all j. Than tho rowt of tho matrix a^ aro taid to bo 1inoarly 
dopondont , that it tono ono of thorn can bo roprooontod at a 
linear combination of tho othoro. If thia cannot bo done, thoa 
tho rowo aro oaid to bo linearly Indopondont . For tho momont, 
lot ut ataumo that tho rowt aro indopondont tir.oo, in praetioo, 
thoro it a way of inturing thia. It it tho flrat roquiroaont 
for obtaining a aolution, tinoo othorwiao ono doot not noooa- 
oarily oxiat for an arbitrary right-hand tide, b^. Tho tignlf— 


icanoo of linearly indopondont rowo it that thoro la alwayt a 
aolution for any giron b^, though not noeotoarily with non-aaga- 
tivo x^. To too that no aolution oxlata for certain if tho 
rowt aro dopondont, find tome tot of not all toro amoh that 


• • • 


MU 
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iXl aj - 0 for all J. Ntxt aat (1 - 1, 

adding togfthtr all aquationa multlpllad by 


, ra). 


glvaa 


Nov 


0 - 2 I a^ - 2 A. > 0 
j 1 1 J 


vhleh la obvloualy Ivpoaalbla for any x'^. Tha laat Inaquallty 
holda baoauaa tha right-hand alda la a aum of aquaraa not a 1 
laro. 

Tha vay In whloh llnaar Indapandanea comaa Into play In 
our problan la that tha Indapandanea of tha m rowa Impllaa that 
thara la at laaat ona aat of ■ colunna vhleh ara alao llnaarly 
Indapandant and hanoa form a baala, that la a aat of oolunna In 
tama of vhleh any right-hand alda ean ba rapraaantad. This la 
uaually provad In tama of datannlnanta or llnaar tranafomatlona. 
Va vlll prova It by allmlnatlon» vhleh la eloaaly allied to tha 
aathod of datarmlnanta (in faet, they uaad to ba callad allnlnanta) 
but vhleh la aiora apropoa of tha alnplax aathod. 


ILKWINTARY ROW TRAWSFORHATIOWS 

Definition ; An alanantary rov tranaformatIon ( E.R.T. ) on an 
nxn matrix a^ la ona vhleh raplacae aoma rov 1 • r vlth 

(X/O, e/r). 

Thaoraw 1 ; E.R.T.a ara ravaralbla and tha Invaraa tranaformatlon 
la an E.R.T. 

Proof; Clearly If a^ - >vaj • / r) than 
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and tht latttr !■ alio an E.R.T. 


Thtoram 2 : E.R.T.a prtttrre llnaar Indtpandanot of tha rovf. 

Proof: Suppost £)\^ a^ • 0 for all J inpllta • 0 

for all 1. Rtplact aj with aj - ^^aJ -f /^aj 

( ^ / 0, fl / r). Now lot//^ bt such that 

1/^4 a^ a^ - 0 for all j. 

l/r ^ J r J 

Thin . - _ 

A ‘j ♦ ♦ -^^r> ‘j ♦ ‘j * ° 

!/• 

which, by abova aisimptlon of Indapandtnoa, lapllaa 
- 0 (1 / r,8) 

A * A/r ■ ° •'“* 

Slnoa A/ 0, • 0 and hanoa • 0. alao. Thua 

tha tranffomad ayatam atlll haa Indapandant rowa. 


Definition : A unit column vactor bj; for 1 < ** i » !• daflnad by 

fo If 1 / r 
|l If 1 - r * 




Tha aat of unit column vactora for r « 1, 2, ..., m. In 
that ordar, fom tha Idantlty matrix of ordar m, 

Ojj (l,h • 1, t m • f m). 

NOTE: 6^ la uauully callad tha Kroneckar dalta. In our notation, 
It la tha Idantlty matrix also. 

Thaoram 3 : Any column In Xj with at laaat ona noiv-saro alaaant 
can be tranaformed Into a unit column vactor by E.R.T.a. 



Proof: Suppose that for column b , a|^ / 0. Then row r oan 

be replaced with aj - aj (j - 1, n). Obviously 

*8 

a^ • I. Then every row 1 / r can be replaced with 

Now clearly for J » s, aj - aj - ai • 0 (1 / r), or, 

BBS 

for all 1 , a^ * bl as was to be shown. 

8 r 


The element a^ In the above proof Is called the pivot element . 

Corollary : If any 6 ^ (q / r) appeared In aj, then It 
remains Intact In a^ . 

Proof: . . 

Suppose aj • 6 ^. Then t/slfq/r. Hence 









.0 



(1 / r) 


Theorem If the rows of aj are linearly Independent then the 

matrix can be transformed Into bj by E.R.T.s so that every 

column of 5^ appears somewhere In b^. 

r y 1 

Proof: Choose some a / 0. By Th. a. can be transformed 

e J 


-1 


-1 


ty E.F.T.s Into a^ where *5 " • No** *^o row of 

Sj can contain all zeros. For, suppose a^ • 0 for 
all J. Then setting \ - 1, ^ - 0 for 1 / q, 


m 


Z A . a^, - 0 for all J 
1-1 ^ 


and the rows are linearly dependent. Hence, by Th. 2, 
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th« rows of Aj «ftr« dAp«ndtnt, contrary to aaaunptlon. 

Honca at can ohooat bom# q / r, t / s for which a^ / 0 

and traniform a^ by E.P.T.e into with a^ ■ 6^. 

j J ^ q 

Howtwtr, any column of 5^^ (h / q) which appeared in 
a^ will remain undisturbed in a^ by the corollary 
to Th. 3 . Thie prooeaa can clearly be repeated until 
every row hai been choaen, each with a different ooluan 
80 that we arrive at the matrl:; as required. 


Corollary : If m > n, then the rows of a^ are dependent. 

Proof: Even assuming we can choose n rows, at that point 
all elements of the transformed matrix will be sero 
except the pivot elements already chosen. Consequently 
the rows of the transformed matrix are dependent, henoe 
so are those of a^. 


We need a few facts which are practically obvious. We will 
state them as lemmas. 


Lemma 1 : Both the rows and the columns of are linearly 
Independent. 

Lemma 2 : If the same E.R.T.s are applied to the right hand side 
of a system of linear equations as are applied to the matrix 
of coefficients, each solution of the original system is a 
solution of the transformed syotero. 

Proof: Suppose 

for some 

■ Ab* -f //b” and thus the r'"' equation of the system 


orniwa wyobvro. 

ippose £ a^ x^ • b^ (i - 1, ..., m) is satisfied 
J ** 

»ome set of values x*^. Then £ (Aa^ -f ^af) x^ 

J J J 

. ij J AM aJ* ^Wa 
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obtalntd by applying an E.R.T. la aatlafltd. Cltarly 
tha othara art alao. Applying this arguaent rtptattdly 
provea tha leaaa. 


Lamma 3 : 


Z 6^ 
} ’’ 

f *1 





f 



6 


1 

J ‘ 


Thaaa all follow laniadlatcly from tha definition of 


Daflnltion ; An roim matrix conalatlng of linearly Independent 
rows la aald to be non-alngular « 

Theorem 5 : If an mxa matrix hae linearly Independent rows, 

It also has linearly Independent columns. 

Proof: Let be auch that - 0 for all 1. We 

can transform ^ by E.R.T.a to which differs from 
bj only In the order of the columna. Applying the 
same E.R.T.a to the right hand aide maintains the 
equalities without changing the But since E.R.T.a 

applied to all seroa obviously give all seros, the 
must all be zero. Hence the columns oTM ^ *^re 
linearly Independent. 

Theorem 6 : If the mxm matrix /'Jj la non-singular, then the 
system of equations 

. b‘ 
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h h 1. 

has a uniqut solution x • p for any glvan whataotvar* 

1 

Proof: By E.R.T.s, can be tranafomed to vhloh 

differs from 6^ at most In the order of the oolumna* 

At the aaBe time, b^ can be tranafomed to If 

* ^r* value of z* must bo and thla la 

true for each a - 1, ...» m. Purtheraore, for each 

such 8, a different value of r will be chosen so that 

r « ^(s) Is a permutation of the Indices a - 1, 

Hence the solution of the transformed system la 

3,h . ^(h)^ 

uniquely. But we can retrace our steps 
to the original system by the Inverse E.R.T.s applied 
In reverse order without changing the values of the 
x^. Hence x^ - ^ ^ ^ solution; It Is 

unique by Lemma 2. 


Corollary to Ths. 5 and 6 : If the tnxa matrix Is 
non-singular, then the system of equations 
m . 

Z “ 0^ 

has a unique solution y^ ■ for any given 
whatsoever. 

Proof: The whole system can be transposed to the fom of 
Th. 6. That Is, let "An replace with 

y^, with c^. Then we have 

J h 1 ^h 
I u. y - c . 

1-1 ^ 

By Th. 5, the rows of uj are Independent. 
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W« now obtwrvt that wt can aolvt a syetero alraultantouily 
for Btvtral right-hand eldta. Suppoat wt wish to find a solu¬ 
tion to ^ 

A ‘5*^ * ^. 

for p dlffertnt right-hand sldos bj, b^, ...» bj. Then we can 
write as an nxp matrix and b|^ as an mxp matrix. Each column 
k of x^ will be the solution to the same column k of b|^. Hence 
we see that. In general, an m n matrix times an nap matrix gives 
an mxp matrix. We will now state the general rule of 


Multiplication of Matrices ; If aj Is an mXn matrix and bj Is 
an nxp matrix then the mxp matrix cj given by the rule of 
multiplication 

y A 

"j 'j 

Is called the product of a^ and b^ In that order. 

Lemma 4 ; Multiplication of matrices Is associative, that is, 
If Sj Is /xm, bj is mXn and Is nXp, then 


m 

Z 

h-1 



n 

Z 

k-1 




n 

Z 

k-1 


m 

Z 

h-1 




c 


k 

J * 


We leave this for the reader to prove to his own satisfaction. 
It Is a well known fact that multiplication of matrices is not 
commutative, that is, even if a^ is min and b^ is nxm (why is 


this necessary?) that 




p -^11 

-1^ 


L bj It not in gentral tqutl to ^ * 

Ic Ic 

Obviously, if ro / n thtn tht two products art not tvsn of tht 

same ordsr. But svsn whan m - n, ths two art not gtnsrally 

tqual. 

Thtorsm 7: If ths mxm matrix is non-singular, than thara 
axiste a uniqua mxm matrix such that 

(5) J /''i 'h * 6^ • 

Proof; Using, for t - 1, m, tha t''^ oolumn of as 

tha right hand aids, wa oan obtain a uniqua solution 
by Th. 6. 

The matrix Is callad tha Invarsa of • 


Theoram 8 ; A non-singular matrix oonnutas with its invarsa. 
Proof; Multiply both sides of (5) on tha left by . 
By lemma 4, wa can combine summation signs: 


£ 




£ t: 




\ ' “k • 

^ '•k 'll ■ 'h 

Hence, by tha Corollary to Th. 5 and 6, which 

with (5) proves the statament. 



THE BASIS IN THE SIMPLEX METHOD 


Suppoft that in lolving an LP probltn In which tht rows 
art llntarly indtptndtnt wt havt arrivtd at a basic solution In 

1 

which a etrtain sat B of m indicts J sptciMts tht basic vari— 
ablts. Tht columns a^ (j6B) art rtferrtd to as a basis . It 
ia oltar that any matrix fomtd from thest colusms is noii-tingular. 

I 

Wt do not know, in gtntral, in what ordtr thtst columns wtrt 
ohostn nor what columns of 0^ thty btcomt in canonical fora, 
i.t. afttr application of tht E.R.T.s. Indttd tht stt of E.R.T.s 
ntotssary to gtt us to this point is not at all unique. Of 
oourst, if wt havt a machint codt, which must follow ctrtaln 
dttailtd rults, and wt feed it the same problem, ordtrtd in tht 
samt way, twict, than it will, wt hopt, do the samt idtntieal 
eptrationa both tints. But a slight changt in tht rules or tht 
ordtr of tht columns will lead to the same result along a differ¬ 
ent path. Wt can avoid a good deal of confusion by distinguishing 
between the index which is the name of a variable and the index 
which denotes the place its coefficient column occupies in a 
particular ordering of the basis. 

Let us pretend that wt have lost all information about our 
basic solution* except the list of name indices in B. Since the 
basic solution is unique, any way in which we reconstruct it is 
valid, that is, an interchange of two columns merely interchanges 
the two corresponding values in the final solution column. Let 
us denote this column by |3 Hence, which x* any particular 
is the value of, depends on what column a| (s £.B) becomes oj; 
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whtn »• trtnifoni tht baeii. L«t us d«not« this oorr«spond«not 
by t • ^(r). Thus ^(h) is a list of ■ namt Indiott ordtr«d on 
h « n. w« will rsfsr to this list ^(h) si tht basis 

htsdings . Wt do not think of it tithtr as a column or a row 
but mtrtly a list dtnoting a eorrtapondtnot. 

Lot us now attampt to raeonstruct our lost solution from 
tha original data and the set B of indices J. Let us form an 
nx?ni matrix in which the first m columns are tha a^ for J in B 
and tha last m are 6^. We will associate tha (((h) with the 
columns of and make (((h) - 0 Initially. 

Prom tha first m columns, choose soma a^ / 0. By E.R.T.s 
on the whole array we can transform a^ into bj;. At tha saaa 
tima wa apply tha same E.R.T.s to tha right-hand side b^. Wa 
also change (((r) to s. We can now choose another pivot element 

—P * ! 

from the first m columns, say a., / 0, and transform column s' 
to bj;, (r' / r, s' / s). Wa make (((r') - s'. Proceeding in 
this manner, wa can change every one of tha first m eolumns into 
unit column vectors and determine tha conpleta list of basis 
headings. 

Now let us suppose the first ro columns had bean ordered in 
the way the list j > (((h) finally turned out. Than these oolwns 
would have bean transformed into tha unit columns in proper order, 
i.e. b^. The last ro columns, initially behave bean transformed 
into the solution to 


m 

£ 

h-1 


♦(h) ’j 



1 . 


» 


■ ) 


( 6 ) 


• f • 
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as la atan In the proof of Th. 6 . (The ^ uatd there waa the 
inverae of the uaed here.) At the aame time, the column 
haa been tranaformed Into the aolutlon to 

(7) ^ *b (l“l, ...,d) 

Henee the last m coluirna have become the Inverse of the ordered 
basis •••» And the value of 

THE TRANSFOiwiATION OF THE COST ROW 

We have neglected thus far the coefficients a^ of the 
objective form. However, in reducing the basis to canonical 
form, there la nothing to prevent us from performing extra E.R.T.s 
on thia row to make each coefficient associated wltn the basis 
vanish. The total effect of all these E.R.T.s Is equivalent to 
solving for variables In a transposed system 

•$(h) ’^l •J(h) * ^ ..., m). 

Putting A^(h) right In (8) and multiplying both sides by 

Vj on the right gives 

i!h ^ j ■" h •> 

or by (6) 

V .1 V -0 h 

1 'l ®J ■ 'j * ■ h iKh) J • 

Hence, the transformed cost coefficients are given by 
(9) <Jj - a® + aj (J - 1. .... n) 
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where dj * 0 for J In B by definition. Note that the order of 
the In (8) le not affected by the ordering J - ^(h) of the 
columne e^. 

The value of the basic solution Is 


m 


■ h^i *♦(*') ^ 


'’bi 


— L ¥*b' 
1 ' 


THE REVISED SIMPLEX METHOD 

The row vector In (8) Is called the pricing vector . At 

seen above. It can be generated at the sane tine aa the Inverse 

h 0 

Is computed. In fact It Is convenient to think of aa y^^. 

The revised simplex method consists of using the pricing vector 

to determine a vector a^ (s^B) to bring Into the basis, and of 

using the Inverse to represent a^ In terns of the basis. It is 

clear by this time, of course, that the transformed column S^ 

used In the original simplex method Is nothing but the values 

of the unknowns or ^ In the equations 

hfi 4'(h) (1 - 1, . 


Whence 


k 1 


.k .1 


The Index s Is chosen as usual by the rule 


d, •• min d. < 0 

“ J J 

taking smallest Index, say, In case of ties. If all d^ > 0, 
then the present solution Is optimal. 



P-911 

8 - 6-56 

- 20 - 


Th« rult for choosing the Index r of the vector to go out 
of the basis la 


( 10 ) 


^ [til 

O • Bln^ ^ 

o<J>o «i I 


If any C<* > 0 


where tone arbitrary tnile la often used to reaolve tlea. Thla 
will be dlsouaaed further In the next aectlon. If all Q(^ < 0, 
then a class of solutions exists 

(11) 2‘Lh) < («> 0) 


with the values 


( 12 ) 


^ •5(h) (P** - ♦ K ■ • •$(h) * 




X > 0 (2 a®) - z + e d^ < z 


and as ^ approaches + oo, this quantity approaches - go. 

1 X* 

If some > 0, then the value of O Is bounded by 6 which 
Is such as to make 

- ©'•(yj . 0. 

•h 

The new values of the other basic variables, oall theo p , will be 


(15) 


,♦(*>) - - ff* _ ©•'o^^ >0 (h / r) . 


We must now remove ^<*oin the basis and replace It with 

aj. This Is formally accomplished merely by making J(r) • s but 

8 

of course we must change the inverse. Since 
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I “(Kh) “• •' 


• $(r) 


cl«arly 

(I't) 


X • 

h/r 


<Kh) 


.-h 


M ma 

— d 
** s 


1 

/•** 

^ ‘s 

r 

"'s 

. - 


0(g 


*^(r) 


Now alnct ' $(N) for h / r, and linct 


<15) *0(h) »5 * •J(r) ’5 

substituting (14) into (15) glvss 


2 ai 

hfir 9(h) 

Thus 


- B' 


- T*“ — 

♦ a‘ 

,«• -L. 

•> Jar 

8 _ 

J(r) 

J 


-«r 


( 16 ) 


• j. 

'j • 

'j 

1 

(j -1, 

I'l - ^5 

-'J 

<=<i 

«r 

(h l‘ r) 


This, of course, is the same kind of E.R.T.s we have bssn making 
right along. Note that ( 15 ) and ( 16 ) Involve tha sama E.R.T.s. 
It Is also easy to shOM that the new pricing vector Is given by 


(17) 



as can be seen by considering the change 
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# 



- L 

h 


•$(h) 


- Z 
h 


J(h) 


•h 


r .0 

' r 


-0 -0 1 

■ Mr 



•${r) 



<X 


r 

1 

r 


• L 


m 

-Z 


1 •♦(h) 


„h . ,o 
^8 ^ '"b 



d 


0 


Since iB tlMtya chosen non-sero, the above E.R.T.s are all 
valid, hence linear Independence of the rows 1b maintained, tfe 
have only to start with the Identity matrix as the initial baela 
to Insure the validity of all transformations. In practice, one 
always does start; with the Identity matrix either because It 
arises from slack vectors, because It Is Introduced artificially 
for a Phase I, or as a convenient way of Inverting a given basis. 
The use of Phase I was discussed In the last lecture and will be 
taken up again In a later one. Hence we will not pursue It at 
this point. 

DEOENERACY 

ke have left to the last the matter of degeneracy, which 
by the rule (10) can conceivably cause Indefinite cycling through 
the same set of bases. It is logically easier to discuss at 
this point but It la also the least Interesting part of the 
theory. There used to be a great hulabalu about this theoretical 
hole in the simplex method but nowadays people more or less 
Ignore It and go on abcut their business. Unquestionably the 



theory had to ba coaplattd but actual cycling in a real problta 
haa never been reported. A few examples have been cooked up to 
prove it can happen. However, no proof has ever been given that 
the simplex method will converge in a reasonable nuaber of iter¬ 
ations, cycling or not. It Just does. 

The proof that the simplex method will eventually reach an 
optimal solution depends on the value of z decreasing by a non¬ 
zero amount each iteration. Since there are only a finite nuatber 
of bases and each succesaive one is better than the last, they 
must eventually terminate. The mere existence of ties in (10) 
does not invalidate this argument, it is only when the value of 
6^ turns out to be zero that a difficulty arises. Unfortunately, 
the schemes that have been devised for avoiding degeneracy depand 
on resolving all ties, zero or not, and on maintaining feasibility 
at every step. We will see later that it is possible and often 
convenient to work with infeasible solutions and henoe rigorous 
resolution of ties becomes impractical since it would require 
extremely elaborate machinery. Nevertheless, we will show how 
degeneracy could be avoided. 

Again we make use of the identity matrix. Instead of a 
single column b^, consider the more general problem restraints 

4 

jfl ‘j ’ ‘’i (k - 0, 1, .... ■) 

where b^ becomes b^ and (k - 1, ..., m). (it Is really 

only necessary that b^ have linearly independent rows but in 
practice the identity matrix is by far the most convenient 
extension so we will proceed on that basis.) We will generalise 



I 
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th« norv-ntgatlvity rtqulrtntnt on tha varlablai as follows. 

Considsr the rows of as Iszloogrsphlcally ordtrsd vectors 
( L.O.V. )« by which wa mean that, for fixed r, and considering 
the whole row st once, 


and 


xj ^ 0 If Xq > 0 or If x^ - - ... ■ - 0. x^ > 0 (l<i^a) 

*k ^ ^ 0 In the above sense. 


The relation denoted by ” ^ " constitutes an ordering on row 
vectors ss is easily seen from the definition. 

The functional is slallarly generalized to 


II * . 

. Z a® x^ 

K j.l J *< 

and the elimination ratio now becomes the vector 


(18) 


e: 


. rain 

0 (g >0 ^8 


(k - 0, 1, ..., ra) 


the mlnlmuin being taken In the L.O.V. sense. Henoe the new 
solution when a^ Is introduced into and eliminated from 

the basis Is 

A** 

.r 


•r K 
/?lc " 


o( 


r -«k 


Clearly, p J ^ 0 If ^ C. Similarly, for all other 1 / r. 


IS 

•r r 


• • • I Ql ^ 


(19) 


(k . 0 . 1, 
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unless, for some 1 - r' and constant c • —r > 0, 


(20) pr ^ ^ l^r ^ 

But this cannot be the cast, for, since the arc obtained 
from by E.R.T.s and the rows of b|^ art linearly Indtpcndant, 
the rows of ^ ^ must be linearly Independent, whereas (20) would 
Imply that with ■!, Aj,"“C^0, 

^r* ^ k ^ r^k “ ° 

Hence (19) holds and therefore 


(k ■•0, 1, •••, m). 


whence 

° If 

We have thus proved that, starting with a basic solution matrix 

^ S 0, the condition will be maintained. If we start with the 
^ 1 

identity matrix as a basis, and all b >0, then the Initial 
basic solution matrix is 

Tb^ 1 0 0 ... 0 

b^ 0 1 0 ... 0 

|_b" 0 0 0 . . . 1 

so that every is strlctlv (L.O.V.) positive. Therefore, at 
every step, the change In the functional 




4 



‘k - • ®k “a 


It etrlotly (L.O.V.) ntgative, slnee d. < 0 by the usual cholot, 
and the proettt must eventually terminate. 

The computation of and as msII as the d^ Is unchanged. 
However, by a very happy circumstance (which we cleverly arranged) 




h 

k 



(h,k - 1, ...» m) 


so we have no additional computation except the '*generallxed ratios" 
In (l8). Even then there Is no extra work unless we find, for 



In which case we examine 


( 21 ) 


oT' 

Pi 


r vs 


(X 


Pi 


a 




vs 



In order until we find a pair of unequal ratios. At we saw 
following (20), all pairs cannot be equal. There may, of course, 
be more than two equal ratios on first components In (18). We 
have merely Illustrated the situation for a two-way tie. 

It should be noted that the choice using (21) may be made 
on negative ratios. In this case, the min In (l6) must be 
understood In an algebraic sense on the "tle~breaker" element 
although there will, of course, be a leading positive element. 

If ■ 0 on the current Iteration, then there must have been 
a tie on the last Iteration which was resolved to make the first 
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nor>-z*ro •lement positive, excepting of course on the first 
Iteration which Is guaranteed O.K. by the Initial solution. 



